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Real-Time Approximations to 
Subsurface Scattering 



Simon Green 
NVIDIA 




J !l f..Mdsr shading models used in rcai^dme graphics today consider the infraction of light 
■^^o^^ihc surface of an object. In the real world, however, many objects are slightly 
translucent: light enters their surface, is scattered around inside the material, and 1'he.n 
exits the surface, potentially at a different point from where it entered. 

ftfe arid accurate models of subsur- 

face light transport. Ai thougli completely physically accurate simulations of subsurface 
scattering are out of the reach of current graphics hardware, it is possible to approxi- 
mate much of the visual appearance of this;cffeccCm^ 

several mediods of approximating the look of translucent materials; such as skin and 
marble, using programmable graphics hardware. 



164 |he Visual Effects of Subsurface Scattering 

Vffo any visual effect, it is often useful to examine images of the 

effect and try to break down the visual appearance into its constituent parts. 

Inking at photographs and rendered images of translucent objects, we notice several 
things. First, subsurface scattering tends to soften rhe overall effect of lighting. Light 
•Irom to bleed into neighboring areas on the surface, and small surface 

details Bcomc less visible. The farther the light penetrates into the object, the more it 



is attenuated and difiuseA Widi skin, scattering also tends to cause a slight color shift 
toward red where the surface transitions from being lit to being in shadow This is 
caused by light entering die surf^ on the lit scat tered and absorbed by the 

blood and tissue baieath the skin, and then exiting on the shadowed side: The effect of 
scattering is mo^: obvious where the slcin is thin, such as around the nostrils and ears. 



16.2 Simple Scattering^ 



W't, "'3 W' 



One.sjmple tridk diac approximates scattering is wrap lighting. Normally, diffuse 
(I^mbert) : lighting contributes zero light ^ die surface normal is perpendicular to 
the light dir^rion. Wrap lighting modifies die diffuse function so that: die lighting 
wraps around the object beyond the pomt ^ere it would normally become dark. Tins 
reduces die contrast of the diffuse lighting which decreases the amount of ambient and 
fill lighting that is requirii Wrap lighting is t crude approximation to the Oren-Nayar 
lighting model; \^\idh aaempts to more accurately simulate rough matte surfaces 
(h%arandOren 1995). 

The code shown here and the graph in Figure 1 6r 1 illustrate how to change the diffuse 
lightifig fe include the wrap effect- The value wrap is a floating-point number 

betvycen 0 and 1 that controls how far the ;Hgh ting : wUl w^ object* 



float dil&sfe ^ w£k{V, dot <L, ) ; 
float \vrap_diffus«s ~ xaspc<0, 



{dotJL, 



N) % wrap) / (1 + wrap) ) ; 



'lb compute diis efficicridy in a fragment prograSpdk function can be encoded in a 
texture, which is indexed by the dot product b<^\veen; the light vector and the normal. 
This texture can also be created to include a slight color shift toward red when the 
lighting approaches zero. This is a cheap way to simulate scattering for skin shaders. 
The same texture can also include the power funaion for speadar lighting in the alpha 
channel. The FX code in Listing 16-1 demonstrates how to use diis technique. Sec 
Figure 16-2 for examples. 



mmmmmmmmmm www i i i m i f, ; . mvnww n .^wimamm mmimmm^ 
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y « (x* wrap)/(l + wrap) 




figure 16-1. Graph of the Wrap lighting Function 



|f } ; 
.- 



Listing 16*1. Excerpt from the Skin Shader Effettincorporating Wrap Lighting 

ff '^m^mm ZB lookup to&ui for skin stu&iagr 
■float4 GenerateSkinl J UT{float2 P : POSZTZOH) : COLOR 



-flaa&*ArgK> ~ 0.2; 

: , f loat^sga tt^r^jLdth ■ » 0,3; 

£ Ioat4 (0. 15, 0.0, 0.0, 1,0) ; 
float shihiness = 40.0; 



float moth a P.x * 2 - 1? // 
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Ustingi6 r i^^ the Skin Shader Effect Incorporating Wrap Lighting 

float: NdotH = P.y * 2 - 1: 



:i f loat Nctotluwr ap - . (Hdo t L , .+ Wrap ) 7 ( 1 wrap ) ; , / / tsrap lighting 
float diffuse = ma*c(N(to^ 

// add color tint- at transit io« friaw: light to dark. 

float scatter = smootiistep{ 0.0, scatterV&dth, K<3otL_virap) * 

satoothstep ( scat terWi'dth '* 2.0, scatteri^idth, 
Nd6tL_y?rap) ; 



float specular = powfNdotH, shininess) ; 

if 1(NdotL_v^rap <- 0) specular - 0; : " ! 

I float 4 : C; 

C;.rgb = diffuses scatter * scatterColor; 
CTa ~ specular; 
return C; 



jigl£3 ^ShadeSkin ( sarrpl^r i2D : , cklrsL^^ 



&■ skin t^iag.;/^^ 





half 3 N'T 




hal£3 L, 




half 3 H, 




{ 

half 2 s; 


half 3 diffuseCclor, 

half 3 specularColor) : COLOR 





S.X = dot {N, L) ; 

S . y =, :: dot: { N / K ) ; 

. ...... . " " . , ' - . - :•• 

half 4 light = tex2i)(skinLOT, -s * 0.5 + 0.5); 

'•return diff useColor * light . rgb +. specularColor * light. a; 



163 Simulating Maps 

One of clue mosci important factors in si mujating very transl ucen t materials is absorp- 
tion. Tlie faith^ it is scattered and 
absorbed. l^mmA^^xhk ^ax, we need a measure of die distance lighr has traveled 
through the material. 
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figure 16-2. Applying Wrap Lighting to Spheres 

Spheres lit (a) without wrap lighting, (b) with wrap lighting, and (c) with wrap lighting and color* 
shift. 



: Qrie method of estimating this distance is to.use depth maps (Hery 2002);vThis teeh^,- 
nique'is very similar to shadow mapping, and it is practical for real-time rendering. In 
the first pass, we render the scene from the point of view of the light, storing the dis- 
tance from the light to a texture. This image is then projected back onto the scene 
using standard projective texture mapping. In the rendering pass, given a point to be 
shaded, we can look up into this texture to obtain the distance from the light at the 
point the ray entered the surface (r/). By.subtracting this value from the distance from 
the light to the point at which the ray exited the surface {d)> we obtain an esti mate of 
the distance the light has traveled through the object {s). See Figure 1 6-3. 



j' 



The obvious problem with this technique is that it; works only with convex objects:! 
holes within the object are not accounted for correcdy. In practice, this is not a big 
iissue, but it may be possible to get around the problem using depth peeling, which re- 
moves layers of thgobject one by one (Everitt 2003). |! - 

You might be thinking that for list^coBj^d;/ irwpuld 6e pd^ible to paint or precalcu- 
> late a map that represents die approximate thickness of die surface at each point. The, 
advantage o^ using depth maps is they take into account the direction of the incoming 
lights iand'diey also work for animating models (assuming that you regenerate the depth 
'map : eacH"ftame). ^ _ . ... 

The programs in Listings 16-2 and 16-3 demonstrate how to render distance from "the 
light to a texture. They assume the modelview and modelViewPro j matrices have 
|^^;:set up by the application for the light view. 
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listing 16-2. The Vertex Program for the Depth Pass 



struct a2v { ' 

f lo&t4 pes ' : POSITION; 
£loat3 normal : NQBI*AL; 

) * " : 

struct:' v2f { 

float 4 hpos : PQSXTIGH; 

float dist : TEXCOGRDO ; // distance to light 

v2f inain(a2v IN, 

uniform f loat 4x4 : mode lyiewPrpj , 
. tmifotm £loat4x4 niodelView. . 

uniform float grow) ' 

{ " 

.j v2f OUT; 

••^•••float4 p = iN.pos; 

•' P.xyz +=• XH, normal * grow; //" scale %?ert^ek alow* animal 

CPT.hpcs = aail (irodelViewPro j , P) ; 

OUT. dist = length (xmil (n»delView, IN.pos) ) ; 
• " return OUT; 

} " 
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listing 16-3. The Fragment Pro-am for the Depth Pass 



-floats main (float dist : TEXO) :> COLOR 

■ • {• : /v.;,:,: :: ^ 

return cist; /./ ,retrar& -distance 



The fragment program extract in Listing 16-4 shows how to look up in the light dis- 
: t^& texture to calculate depth. For flexibility, this. code does the projection in; the 
fragment programv but if you are taking onl^ adpw samples, it will be more efficient to 
calculate these transformations in the/vertex program. 

Listing 16-4. The Fragment Program Function for Calculating Penetration Depth Using Depth Map 

// 'Given a point in oh: act space, Xcctop into depth textures 

float trace (float 3 p, 

uniform float 4x4 'ljghtTerf^atrix, /> to light texture space 
: uniform float 4x4 lightMstrix, //to light: space 
; ^££o^~<s3^ter2D lightDepthTex, . 



) 



{ }04 . 

j* ii transform ^int r irio light te»ure«' space 



float4' t;exCoprd =-imiI (light TexKatrix, £loait4(F, 1.0) )/;' 



0 1 



• 'v- - 

// get dist^ee froKi light at entry point 

float d_i = tex2Dproj (lightDepthTex, texCocrd.xyw) ; 



""•""?> t'r&nsfcrra position to light space 

float* Flight f^aui ( lightMatr ix, £loat4(P, 3.0)! 

fet// distaste of this pixel from light- < exit) 
| f loaf :v = length (Plight) ? 

:!,! caiculafca depth 
• f loat s = ".dLo..- d^i? 
xretuxri s ; • 



a measure of the distance the light has traveled through the material, 
there are several ways we can use it. One simple way is to use it to index directly into an 
artist-created ID texture that maps distance to color The color should fall off exponen- 
tially with /distance; By changing this color map, and combining the effect with other, 
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more traditional lighting models, W'e can produce images of different rnatcrials, such as ' ; 
marble or jade. , . • • v .j. 

float si = trace (IN. obj Coord, light TexMatrix, lightJMtrix, 

light DcpthTex) ; '• 
return texlJD { scat tcrTex , si); 

Alternatively; we can evaluate the exponential function directly: 
. return , exp{ -si * sigma_t} *. lightCclor; * '.; ' 

The problem with this technique is that it does not simulate the way light is diffused as 
it pa^^ thncoigli the object. When the light is behind the object, you will often clearly 
r:r;i ;:see features from the back side of the object showing through on the front. The solu- 
tion to this is to take multiple samples at differ^ use a 
different diffusion approximation, as discussed in die next sectioni; 

16.3.1 implementation Details ; %msm% $m - \Z 

On GeForce FX hardware, when reading from a depth texture- only the" most signifi- 
cant eight bits of the depth value are available. This is not sufficient prcpsion. Instead, 
we can either use floating-point textures or use the pack and unpack instructions from 
^'^thc NVIDIA fragment progra m extension to store a 32-bit float value in a regular 
eight-bit RGBA texture. Floating-point textures do not currently support filtering, so 
block artifacts will sometimes be visible where the projected texture is magnified. If 
necessary, bilinear filtering can be performed in the shader, at some performance cost. 

""Another problem widi projected depdv maps is that artifact often appear around the 
edges of the projection. These are similar to the self-shadowing arafacc,scen wirh 
shadow mapping. They result mainly from the limited resolution of the texture map, 
vyhich'causes pixels from the background to be projected onto the edges of the object. 
The sample code avoids dbis ; prpblerii; by si i gh tly scaling the object along die vertex 
normal during the depth-map pass. 

For more accurate simulations, we may also need to know the normal, and potentially 
the surface color, at the point at w-hich the light entered the object. We can achieve this 
by rendering additional passes that render die extra informaoon to textures. We can 
look up in these textures in a similar way to the depth texture* Oh systems that support 
multiple render targets, it may be possible to collapse the depth, normal, and other 
passes into a single pass that outputs multiple' values. See Figure 16-4. 



M 
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1 Wmm si: 




Thin parts of the object transmit more light 



■II v: 



16.3.2 , IVIore Sophisticated Scattering Models 

More sophisticated models attempt to accurately simulate the cumulative effects of 
scattering within the medium. 



mm 



One model is chc jmgi? scattering approximation, which assumes that light bounces only 
once within the material. By stepping along the refracted ray into the material, one can 
estimate how many photons would be scattered toward die camera. Phase functions are 
used to describe the distribution of directions in which light is scattered when it hits a 
panicle. It is also important to take into account the Fresnel effect at the entry and exit 



points. 





















Another mod el > the diffusio?rapproxi7natio?i y si mulates the effect of multiple sbinmrig 
for highly scattering media, such as skin. 



mi 



16.3 Simulating Absorption Using pepth^^sr 



Unfortunately; these techniques are„beyon^ chapter. ; ; 

Christophe Hery s chapter from the SIGGR/XPH 2003 RenderMan course (Hery 
2003) goes into the details of single and diffusion 

: " 

16.4 Texture-Space Diffusion 

As we noted earlier, one of the most obvious visual signs of subsurface scattering is a gen- 
eral blurring of the effects of lighting. In fact, 3D artists Soften emulate this phenomenon 
in screen space by performing Gaussian blurs of their renders in Adobe Photoshop and 
then addi ng a small amount of the blurred imiigc back on top of the original. This "glow" 
technique softens the lighting and makes; die irrikges look less computer-generated 

It is possible to simulate diffusion in texture space (Borshukov and Lewis 2003). We 
.can unwrap the mesh of the object with a ^ vertex program diat uses the U V texture 
coordinates as: the screen position of the vertex. The program simply remaps the [0, 1] | : 
range of the texture coordinates to the f-I, 1 1 range of normalized device coordinates. \ 
We have to be careful that the object has a good UV mapping that is, each point on f. 
flthc texture must map to only one point of the object, with no overlaps. By lighting this f 
unwrapped mesh in the normal way, we obtain a 2D image representing the lighting of 
the object; We can then process this image a^d reapply it to the 3D model like a nor- 
mal texture. ' J • ; ' ' ' '* f 

The vertex program in Listing 16 5 demonstrates how to render a model in UV space 
and perform diffuse lighting. 

This technique is useful for other applications, because it decouples the shading com- 
plexity from the screen resolution; shading is performed only for each texel in the tex- 
ture map, rather than for every pixel on the object. Many operations, such as . 
convolutions, can be performed much more efficiently in; image space than on a 3D 
surfece. If the UV parameterization of the surface is relatively uniform, this is hot a bad 
^approximation, because points that are close in world space will map to points that arc 
- also cldse in texture space. -S^-. ^ . 

iij|g emulate light diffusion in image space, we can simply blur jch^U^yrap'-jcxturc, 
, ; ^.gan take advantage of all the usual GPU image-processing tricks, such as using . 
separable filters and exploiting bilinear filtering hardware- Rendering the lighting to a 
relatively low-resolution texture already provides a certain amount of blurring. Figure 
l6-5;shows an unwrapped head mesh and the results of blurring the light map texture. 
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listing 16-5. A Vertex Program to Unwrap a Model and Perform Diffuse Lighting 



struct a2v { 
floats pos- 



£loat3 normal : NORMAL; 
float 2 texture : TEXCOOBJ^-p. 

} ; 

struct v2f { 

£loat4- hpos : POSITION; 

f loat2 texcoord : TEXCOORDO; 

: COLORO; 



float 4 col 



lllllil 



:\ life 

;:: :• : . v , .. ^"^-^^M^m m^fM-^-M -M 

; urd f orui; £ lea t4x4 ] ichtiMatr i.x) 



; 1 v2f;Tnaih(a2v IN-, 



:;y2-f OUT; 



//convert tenure coordinates to* HDC position 11 
OUT, hpos. xy - TK. texture * 2-1; 
OUT . hpos . Z ~ Oil); 



hi 


X 


B. 


W 


= 1. 


0; 















7/ &i££\ise : lighting.: ^ 
float3 Iv = normalize (rail ( (float 3x3) lightMatrix, IK .normal ) ) ; 
float 3 L = normalize ( ~mul (light Matrix^ IN. pes) .xyz) ; 
float diffuse - max (dot (K, L) , 0) ; 
OUT*, col = diffuse; 

COJT. texcoord = IIf. texture; 
literetxirn OUT; 



A diffuse color map can also be included in the lighr map texture; then details from the 
color map will also be diffused. If shadows are included in the texture, the blurring 
process i i^ll [resu I r in soft shadows. 

To simulate the fact that absorption and scattering are wavelength dependent, we can 
alter the filter weights separately for each color channel The sample shadcr, shown in 
Listings 16-6 and 16-7, attempts to simulate skin. It takes seven texture samples with 
BaiMari weights. The width of the filter is greater for the red channel than for the 
gretn arid blue channels, so that the red is diffused more than the other channels. The 
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Figure 16-5. Unwrapped Head Mesh 

The mesh is shown (a) before and (b) after blurring the light map texture. 



vertex program . in Listing 16-6 calculates the sample positions for a blur-in the 
tion; the program for the^ direction 15 almost identi(^l.tThe saimples are spaced r\yo 
texels apart to take advantage of the bilinear filtering capability of the hardware. 



Listing 16-6. The Vertex Program for Diffusion Blur 



v2 f main ( float2 tex : TEXCOORDO) 

[ ' 
v2£ OUT'; 

// 7 sarqples, 2 texel spacing 
OUT.texO tex + float2{-5.5, 0) ; 
.OUT.texl •= tex + float:2(-3.5, 0) ; 
" ! OUT.tex2 = tex + float2{-1.5, 0) ; 

CUT.tex3 = tex + float2(0, 0); 
mJOUT.texA = tex + float2(3.5, 0) ; 
OUT.tex5 - te>: + £loat2{3.5, 0) ; 
= QUTltex6 = tex + f!oat2(5.5, 0) ; 

} . " : " 



In. --«■ i/-: 



' 'Kin;;::; 



tJstSng t6^ The fragment Program for Diffusion Blur 



half 4 main Cv2f Connector v2f , 

uniform sampler 2D LigbtTex 



COLOR 



.// weights fco blur red cterz^el more than green and blue 



-conet.; float4 weight: [7] ~ { 

{ 0.006, 0.0, 0.0, 0.0 } 

{ 0.061, 0.0, 0.0, 0.0 } 

{ 0.242, 0.25, .0.25, CO- } 

^ / { 0.363, 0.5, ,0.5, 0.0 } 

{ 0.242, 0.25, 0.20, 0.0 } 

.{ 0.061, 0.0, 0.0, 0.0 } 

f 0.006, 0.0, tills 0.0 ) 

}; 



half 4 a; 

a I tex2D(lightTex, 
a += tex2D(lightTex, 
a jr= tex2D(lighLTex / 
a +~ tex2D{lightTex, 
a *=\tex2D{lightTex, 
a += tex2D( light Tex, 
a || tex2D(lightTex/;- 
return a; 



v2f . texO) 
v2.f : .t ; exi;) 
v2f i tex2) 
v2f .tex3) 
v2f .tex4) 

■ v 2 f J t e>: 5 ) *; v we Igh t, f 5 f , 
v2 T; . tex6 ) 



weight [0] 
weight [1] 
weight [2] 
weight [3] 
weight f4] 



»' *• weight [6 J 



' .V:=i!::;iir: : : 



To achieve a wider blur, you can either apply the blur shader several times or write a 
shadcr that takes more samples by calculating the sample positions in the fragment 
program. Figure 16-6 shows the blurred light map texture applied back onto the 3D 
head model. 



The final shader blends the diffused lighting texture with the original high-resolution 
color map to obtain the final effect, as shown in Figure 16-7. 



Possible Future Work 



One possible extension to the depth map technique would be to render additional depth 
passes to account for denser objects within the object, such as bones within a body. The 
problem is that we are trying to account for volumetric effects using a surface-based 
representation. Volume rendering does not have this restriction, and it can produce 



much more accurate renderings of objects whose density varies. For more on volume 
rendering, see Chapter 39 of this book, 

Another possible extension to this technique would be to provide several color maps, 
each representing the color of a different layer of skin. For example, you might provide 
one map for the surface color and another for the veins and capillaries underneath the 
skiru i P'f ! f, 



Greg James (2003) describes a technique that handles arbitrary polygonal objects by 
first adding up the distances of all die back-facing surfaces and then subtracting the 
distances of all the front-facing surfaces. His .application computes distances in screen 
spacfc for volumetric fog effects, but it could : jc>e cite nded to more general situations. 



Aii» interesting area of future research is combining the depth-map and texture-space 
techniques tq obtain the best of both worlds. 



16.5 Conciusiln^ pi - " • ; \ ::: 

Tflie effects of subsurface sea traingare anui^ 

images: of skin and; other translucent materials. By using sieyeral different approxima- 
tions, we have shp\yn hmv to achieve much of the look of subsurface scattering today in 
real time. As : ^raphics hardware becomes more: powerful, increasingly accurate models 
of subsurface light transport wall be possible. 



. We hope that the techniques described m this chapter will inspire you to improve the 
realism of real-ume game characters. But remember* good shading can never hdp bad art! 
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